# Real-time Interaction

Tencent Hunyuan Image 2.0 is Tencent's latest released AI image generation model, significantly improving generation speed and image quality. With a super-high compression ratio codec and new diffusion architecture, image generation speed can reach milliseconds, avoiding the waiting time of traditional generation. At the same time, the model improves the realism and detail representation of images through the combination of reinforcement learning algorithms and human aesthetic knowledge, suitable for professional users such as designers and creators.

Beyond Presence is a company focused on leveraging digital twin technology to create human-like conversational experiences. Its core product is interactive conversational avatars capable of highly realistic real-time dialogue. This technology simulates human appearance, voice, and behavior, providing businesses with a novel customer service, sales, and training solution. It not only reduces labor costs but also enables 24/7 uninterrupted service, improving customer satisfaction and loyalty. Furthermore, the product supports multiple languages, meeting the needs of users in different regions globally. Beyond Presence's product is positioned to provide businesses with efficient, personalized, and innovative digital interaction tools. Its pricing strategy is flexible, including free trials and various packages such as personal, professional, business, and enterprise plans to cater to clients of different scales and needs.

Conversational Video Interface (CVI) is an emotionally intelligent conversational video interface launched by Tavus. It uses three models working together—Phoenix-3, Raven-0, and Sparrow-0—to give AI true human-like perception, listening, understanding, and real-time interaction capabilities. CVI is not just a tool, but a completely new way of human-computer communication, applicable to multiple fields such as healthcare, mental health, sales training, and customer service, with limitless usage scenarios. The technological breakthrough behind it lies in integrating the subtle emotions and rhythms of human conversation into AI interaction, making AI more than just a simple response, but something that can think, react, and change how we interact with machines.

Rapport AI-Driven Avatars is an AI-powered virtual avatar platform focused on creating, animating, and deploying interactive virtual characters with emotional intelligence. The platform supports multilingual real-time interaction and is compatible with various devices and platforms. Its core technology includes real-time audio-driven facial animation and precise lip-sync, providing exceptional visual effects through collaboration with Speech Graphics. This product primarily targets education, corporate training, entertainment, and marketing sectors, aiming to enhance user engagement and learning outcomes through immersive experiences. The platform offers a free Explorer tier and a paid Creator tier, the latter supporting more advanced features and customization options.

LiteAvatar is an audio-driven real-time 2D avatar generation model primarily designed for real-time chat scenarios. Through efficient speech recognition and viseme parameter prediction technology combined with a lightweight 2D face generation model, it achieves 30fps real-time inference using only CPU. Key advantages include efficient audio feature extraction, a lightweight model design, and mobile device-friendly support. This technology is suitable for real-time interactive virtual avatar generation scenarios such as online meetings and virtual live streaming. It was developed based on the need for real-time interaction and low hardware requirements. Currently, it is open-source and free, positioned as an efficient, low-resource-consuming real-time avatar generation solution.

Smallest AI is a company focused on providing real-time AI services. Its Waves and Atoms products are specifically designed for generating high-quality AI voices and providing real-time AI customer service agents, respectively. Waves can generate AI voices in any accent, language, or emotion in real-time, suitable for scenarios requiring personalized voice interaction. Atoms uses AI to communicate with customers over the phone, reducing the burden on corporate customer service. The importance of this technology lies in its ability to help companies improve customer experience while reducing labor costs. It is positioned to provide companies with efficient and personalized AI solutions. Specific pricing is not explicitly mentioned on the page, but based on the nature of the service, it is presumed to be a paid model.

Zonos-v0.1 is a real-time text-to-speech (TTS) model developed by the Zyphra team, equipped with high-fidelity voice cloning features. This model includes a 1.6B parameter transformer model and a 1.6B parameter hybrid model, both released under the Apache 2.0 open source license. It can generate natural and expressive speech from text prompts and supports multiple languages. Additionally, Zonos-v0.1 enables high-quality voice cloning from 5 to 30-second voice clips and can be adjusted based on speaking speed, pitch, quality, and emotion. Its key advantages include high generation quality, support for real-time interaction, and flexible voice control capabilities. The release of this model aims to advance research and development in TTS technology.

The Matrix is a pioneering project aimed at creating a fully immersive and interactive digital universe through AI technology, blurring the lines between reality and illusion. This project transcends existing video model limits by providing frame-level precision in user interaction, AAA-level visuals, and infinite generation capabilities, offering users endless exploration experiences. The Matrix is co-developed by Alibaba Group, The University of Hong Kong, The University of Waterloo, and the Vector Institute, representing a new pinnacle in world simulation technology.

Decart is an efficient AI platform that offers orders of magnitude improvements in training and inference for large generative models. Leveraging these advanced capabilities, Decart enables the training of foundational generative interactive models accessible in real-time. Decart's OASIS model is a real-time generative AI open-world model that represents the future of real-time video generation. The platform also features the ability to train or infer on clusters of over 1000 NVIDIA H100 Tensor Core GPUs, bringing groundbreaking advancements to the AI video generation space.

Kimi Exploration Edition is an advanced deep reasoning AI search feature of Kimi. It interprets and breaks down problems, then searches and infers answers, allowing for thorough reading of 500 pages in a single search. This new feature enables Kimi to think like a human, providing more accurate and practical search results. It can also use mathematical models and programming to tackle complex issues, and engage in self-reflection when needed to optimize answers. In short, the Kimi Exploration Edition makes AI search smarter and closer to human cognitive processes.

InterTrack is an advanced tracking technology that can monitor human-object interactions in monocular RGB videos, maintaining tracking continuity even under occlusion and dynamic motion. This technology does not require any object templates and can generalize well in real-world videos through training on synthetic data. InterTrack improves the accuracy and efficiency of tracking by decomposing the 4D tracking problem into pose tracking for each frame and optimizing standardized shapes.

Aurore.ai is an intelligent companion application designed to enhance user experience in gaming and work efficiency through chat, strategy discussions, and companionship. Utilizing the latest artificial intelligence technologies, it offers real-time auditory and visual interactions along with a personalized experience. Aurore.ai collaborates with ChatADy.com, allowing users to recharge their balance through interaction with Aurore.

metahuman-stream is an open-source project for real-time interactive digital human models, facilitating synchronized audio and video dialogues between the digital persona and users. This project supports various digital human models, including ernerf, musetalk, and wav2lip, and features capabilities like voice cloning, interruption during speech, and full-body video stitching, showcasing significant commercial application potential.

HeyGen Interactive Avatar is an online AI video generator focused on creating and optimizing virtual avatar videos with real-time interactivity. It allows users to create avatars optimized for continuous streaming while reminding users to minimize head and hand movements. HeyGen's background includes collaborations with well-known figures like Baron David and Ryan Hoover, and the product is currently in beta testing with a free trial available.

Scoopika is an open-source developer platform designed to empower developers to build personalized AI agents that can see, speak, hear, learn, and take action. It provides a secure, efficient, and user-friendly platform for the AI era, supporting full edge compatibility and real-time streaming. Built-in visual and voice chat functionality enhances user interaction. Scoopika emphasizes its open-source nature, offering server-side and client-side runtimes, as well as integration modules for React projects, fostering a vibrant and growing developer community.

Azure Cognitive Services Speech is a voice recognition and synthesis service launched by Microsoft. It supports speech-to-text and text-to-speech functionality in over 100 languages and dialects. By creating custom voice models that can handle specific jargon, background noise, and accents, it enhances transcription accuracy. Additionally, this service supports real-time speech-to-text, speech translation, and text-to-speech functionalities, catering to various business scenarios such as caption generation, call record analysis, video translation, etc.

DemoDazzle is an AI-driven demonstration platform that leverages OpenAI's advanced language models to automate various product and service demonstration and guidance processes. The platform creates customized virtual avatars, providing real-time AI conversations and question-answering to enhance user experience and satisfaction. The product's key advantages include intelligence, personalization, and high efficiency. DemoDazzle is expected to launch soon and is currently in testing mode.

Developed by Microsoft Research, VASA-1 is a model focused on generating realistic facial animations synchronized with audio in real time. Utilizing deep learning algorithms, it can automatically generate corresponding mouth movements and facial expressions based on input speech, providing users with a novel interactive experience. VASA-1's key strengths lie in its highly realistic rendering effects and real-time responsiveness, enabling virtual characters to interact with users more naturally. Currently, VASA-1 is primarily applied in virtual assistants, online education, and entertainment domains. While its pricing strategy has not yet been announced, a free trial version is expected to be offered for user experience.

Video2Game is a technology that can transform a single video into a high-quality virtual environment with real-time interactivity, realism, and browser compatibility. It achieves high-quality surface geometry by constructing a large-scale NeRF model, which is then converted into a grid representation with corresponding rigid body dynamics to support interaction. Using UV-mapped neural textures ensures both richness of expression and compatibility with game engines. The final result is a virtual environment where virtual characters can interact, respond to user control, and provide high-resolution rendering from new camera perspectives in real time.

WebVoyager is an innovative large multimodal model (LMM)-powered web agent that can complete user instructions end-to-end by interacting with real-world websites. We propose a novel web agent evaluation protocol to address the challenge of automatic evaluation for open-world agent tasks, leveraging the powerful multimodal understanding capabilities of GPT-4V. We collected real-world tasks from 15 widely used websites to evaluate our agent. We demonstrate that WebVoyager achieves a 55.7% task success rate, significantly outperforming the performance of GPT-4 (with all tools) and WebVoyager (text only) settings, highlighting WebVoyager's superior capabilities in practical applications. We find that our proposed automatic evaluation achieves 85.3% consistency with human judgment, paving the way for further development of web agents in real-world environments.

RoboResponseAI is a proactive chatbot powered by generative AI. It can initiate conversations and continuously improve based on user feedback, increasing the percentage of website visitors who convert into leads. It can guide visitors by asking relevant questions based on page content and visitor behavior, effectively leading and increasing lead conversion rates. It also collects valuable feedback from users before they leave, helping you optimize your business. RoboResponseAI also provides personalized and human-like responses, making customers feel closer to your business.